USE OF META-ANAIiYSIS: EPIDEMIOLOGIC STUDIES ON ETS MTD LUNG CANCER 


I n't roduct-i om 

The statistical procedure of meta-analysis treats the 
results of individual studies as individual data points in an 
overall analysis. It has been used effectively in combining the 
results of randomized, controlled clinical trials of 
pharmaceuticals. Such studies are eminently comparable because 
their methodologies and study populations are very similar. 


More recently, meta-analysis has been used' to analyze 
the results; of epidemiologic studies, that is, to calculate an 
overall relative risk as a weighted average of the relative risks 
of many studies. Because of the inherent differences in study 
design, meldikodology, and sample population, especially In the case 
of epidemiologic studies on ETS and lung cancer, questions have 
been raised regarding the appropriateness of using this procedure 
to analyze epidemiologic data. However, meta-analysis is still 
being: used; most recently, the U. S . Environmental Protection Agency 
(EPA)i used a meta-analysis to calculate an estimated overall 
relative risk for lung cancer related to exposure tO' environmental 
tobacco smoke (ETS).^ 


The EPA meta-analysis is not the first in this area, jyj 


given in Tcd>le 1 for comparison.' 


The risk estimates calculated by several other meta-analyses arejl^i 
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Source: https://www.industrydocunnents.ucsf.edu/docs/xmnxOOOO 



In addition to its meta-analysis on United' States ETS- 
lun 9 cancer studies, the recent paper by Fleiss and Gross (il991)i 
presents a detailed criticism of the meta-analytical method, 
particularly as applied to the ETS literature.® This is a thorough 
review paper and a useful reference. Some relevant quotations 
follow: 


[T]he authors of the NRC report appear not to 
have followed the major guidelines proposed by 
Sacks, et al. For example, they did not provide 
a formal protocol for the meta-analysis, nor, 
apparently, did they give any consideration to 
the possibility of heterogeneous ORs across 
the several studies. (p. 134) 

Furthermore, the question comes to mind whether 
the existing epidemiological studies of a 
possible association between exposure to ETS 
and the incidence of lung cancer in non-smokers 
are of adequate quality. Indeed, there is the 
question whether any of these studies meets 
even minimal standards of quality. (pp. 134- 
135)' 

There are many reasons for restricting attention 
to American studies of whether there is an 
elevated risk of lung cancer to noni-smokers 
exposed to ETS relative to non-smokers not so 
exposed'. One is that this is the population 
to whom policy decisions will apply and on 
whom those decisions should be based', (p. 135) 


Odds ratios from studies in other countries, 
on the other hand, are derived from 
distributions that may differ markedly from 
those in the U.S., and thus the ORs themselves 
may not be relevant to the American experience. 
Genetic and lifestyle differences between the 
U'.S. population and the populations studied 
elsewhere (mainly in east Asia) also argue for 
a meta-analysis only of U.S. studies, (p. 135) 
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Source: https://www.industrydocunnents.ucsf.edu/docs/xmnxOOOO 



[U]ncritical use of meta-analysis can and does 
lead to unsubstantiated conclusions. Only 
when all the issues that we have discussed are 
considered and possibly accounted for is it 
possible to apply meta-analysis so that the 
overalli result is scientifically valid. (p. 
137) 

It is very unlikely that the biases present in 
the epidemiological studies of the possible 
association between exposure to ETS and the 
risk of lung cancer can ever be removed'. The 
meta-analysis performed by the NRC must either 
be completely discounted or, as Stein concluded 
so succinctly in another context, considered' a 
mere 'computational exercise.' (p. 137) 


(An editorial comment on this paper by Spitzer is also included. 


Copies of some of the referenced articles are included 
at Tabs 1-4 . They are highlighted in yellow for useful information, 
and in blue for adverse information. 
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Table 1 


. Results of Meta-Analyses of Epidemiologic Studies of Spousal Smoking and Female 


Lung Cancer 



Meta-Analvsis 


SumBarv Risk Estimate 

Studies Included 

Wald, et al., 1986 


1.35 (95% Cl 1.19-1.54) 

13; 10 case-control, 3 cohort 

NRC, 1986 


1.32 (95% Cl 1.16-1.51) 

13; 10 case-control, 3 cohort 

Blot and Fraumeni, 

1986 

1.3 (95% Cl 1.1-1.5) 

12; 10 case-control, 2 cohort 

Wells, 1988 


1.44 (95% Cl 1.26-1.66) 

17; 14 case-control, 3 cohort 

EPA, 1990 


1.41 (95% Cl 1.26-1.57) 

22; 19 case-control, 3 cohort 


» 

1.25 (95% Cl 1.03^1.52) 

8 U.S. studies; 7 case-control, 
1 cohort 

Letzel and Uberla, 

1990 

1.118 

12; 10 case-control, 2 cohort 



1.076 

11; 9 case-control (Trichopoulos 

Flelss and Gross, 

1991 

1.12 (95% Cl 0.95-1.30) 

excluded), 2 cohort 

9 y.S. studies; 8 case-control. 

Layard and LeVois, 
(unpublished) 

1991 

1.08 (95% Cl 0.96-1.22) 

1 cohort 

26; 23 case-control, 3 cohort 
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